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Description 

The present invention relates to a method of processing requests for the 
5 allocation of a memory block of a data memory, and to a method of managing a data 
memory. 



Background Art 

Memory allocators are used by operation systems to allocate free memory 
upon request from an application. In hardware using a Page Memory Management 

10 Unit (PMMU), the memory is divided into fixed-sized memory pages. Accordingly, 
a simple way of allocating memory is the allocation of free fixed-sized memory 
pages. One drawback of this approach is that it is inflexible, especially in 
applications requiring the allocation of small and large memory block. As a 
consequence, memory is wasted. 

15 In general, there are different approaches to deal with the problem of 

memory allocation. One approach is called "First Fit". It is fast but wastes memory. 
An example is to allocate memory segments the size of which is the upper power of 
two value nearest to the requested size. For example, satisfying a request for 2049 
bytes results in the allocation of 4096 bytes. Thus, 2047 bytes are wasted. This 

20 causes memory fragmentation. After hundreds or thousands of memory allocations 
and releases, free segments are scattered across the memory and it becomes more 
difficult to allocate large enough segments, because free segments are small and 
disjointed, although there is sufficient memory left. 

Another approach is called "Best Fit". In this approach, memory wastage is 

25 limited, but a segment allocation requires all free segments to be searched in order 
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to select that segment whose size comes closest to that of the requested memory 
block. This approach addresses fragmentation issues but is not deterministic. 

Realtime operating systems require a fast allocation and low fragmentation 
of memory. In addition, memory allocation and release should be performable at 
5 task and interrupt level. In the latter case, both response time and determinism are 
crucial. At present, conventional "First Fit" and "Best Fit" algorithms do not satisfy 
these requirements. 

There is thus a need for an improved method of managing memory 
allocation requests. The present invention aims to address this need. 

10 

Summary of Invention 

According to one aspect of the invention, there is provided a method of 
processing requests for the allocation of a memory block of a data memory, wherein 
segments of the data memory are allocated to different levels according to their size, 

1 5 the method comprising the steps of: (a) receiving a request for the allocation of a 
memory block; (b) determining the lowest of said levels containing a segment of the 
same size as or larger than the requested memory block; (c) determining, in the 
level determined in step (b), the availability of a free segment of a size the same as 
or larger than the requested memory block; and (d) depending on the determination 

20 in step (c), allocating a free segment. 

According to another aspect of the invention, there is provided a method of 
managing a data memory, the method comprising: defining a number of levels of 
the data memory; defining a different granule size for each level; defining a 
different range of a plurality of different sizes of memory segments for each level, 
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wherein the size of each memory segment is related to the granule size of the 
respective level, and wherein a request for the allocation of a memory block is 
processable by determining a level containing segments of the same size as or larger 
than the requested memory block, and allocating a free segment of a size the same 
5 as or larger than the requested memory block in that level. 

According to another aspect of the invention, there is provided a method of 
managing a data memory comprising memory segments of different sizes for 
allocation in response to memory allocation requests, the method comprising: 
creating a first doubly linked list of consecutive memory segments irrespective of 

10 size and status (free, allocated); and creating a second doubly linked list of free 
memory segments of the same size. 

According to another aspect of the invention, there is provided a method of 
managing a data memory, the fnethod comprising: allocating free segments of the 
data memory to different levels according to their size; and providing a bitmap 

1 5 comprising different stages, wherein the bits of one stage are indicative of the 
availability of free segments in said levels, and the bits of another stage are 
indicative of the state and/or size and/or location of free segments. In particular, a 
last stage of the bitmap is directly indicative of the state of segments and of the size 
and location of free segments. 

20 According to another aspect of the invention, there is provided a method of 

managing a data memory, including freeing and allocating segments of the data 
memory, the method comprising, when freeing a memory segment: determining the 
state of memory segments adjacent to the memory segment to be freed; and merging 
the memory segment to be freed with free adjacent memory segments. 
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According to another aspect of the invention, there is provided an operating 
system for a computer, adapted to perform any of the above methods. 

According to another aspect of the invention, there is provided a computer 
program adapted to perform any of the above methods when operated on a 
5 computer. 

According to another aspect of the invention, there is provided a storage 
medium having stored thereon a set of instructions, which when executed by a 
computer, performs any of the above methods. 

According to another aspect of the invention, there is provided a computer 
10 system programmed to perform any of the above methods. 

According to another aspect of the invention, there is provided a processor 
arranged to perform any of the above methods. 

An algorithm according to an embodiment of the invention provides for a 
deterministic "Best Fit" approach for allocating and freeing memory segments at 
1 5 both task and interrupt level, thereby to reduce memory fragmentation and to 

improve efficiency in managing the memory. In particular, the algorithm does away 
with loops when scanning the memory for free segments, thereby providing 
determinism and predictability. The algorithm can be implemented using any 
processor. Also, the algorithm can be implemented using hardware or software. 
20 The invention aims to minimize wasted memory. For request sizes greater than 640 
bytes, the percentage of wasted memory is less than 5%. 
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Brief Description of the Drawings 

An exemplary embodiment of the invention is described hereinbelow with 
reference to the drawings, of which: 

Figure 1 illustrates the range of segment sizes of a first level of a data 

5 memory; 

Figure 2 a three-stage bitmap for indicating the state of memory segments; 
Figure 3 a deterministic "Best Fit" memory segment allocation algorithm; 
Figure 4 an algorithm to determine bitmap indexes; 
Figure 5 an algorithm to find set bits of the bitmap indicative of a free 
10 segment; 

Figure 6 a data structure used in the "Best Fit" memory allocation algorithm; 
Figure 7 a deterministic "Best Fit" memory segment release algorithm; 
Figure 8 a first doubly linked list linking memory segments; and 
Figure 9 first and second doubly linked lists linking memory segments and 
15 free memory segments of the same size, respectively. 

Detailed Description of an Embodiment 

According to an embodiment of the present invention, an algorithm is 
provided which is characterised by allocating memory segments from different 
20 levels according to their size, using a different granule size (power of two) for each 
level, and using a multiple-stage bitmap in order to increase the speed when dealing 
with requests for the allocation of memory blocks. 

More particularly, memory segments are allocated from seven levels 
according to their size. An range of acceptable segment sizes is defined for each 
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level. In particular, a granule size is defined for each level, and 255 fixed different 
segment sizes are defined as multiples of the granule size. The largest supported 
segment size for a given level is 

max9egSze= 2 W = 256 x G 
5 where G is the granule size of the level. 

Each level represents a table containing pointers pointing to a list of free 
memory segments of the sizes defined for that level. Thus, there are up to 255 
pointers in each table. 

Figure 1 illustrates the sizes of memory segments defined for level 0. Level 
10 0 has a granule size of 32 bytes. The size of segments of level 0 ranges from <64 
bytes to <8192 bytes. There are 255 different segment sizes. 

Table 1 indicates the granule size and memory segment size range for each 

level: 



Granule size 


Memory segment size range 


Level 


32 bytes 


segment size of 1 to 8191 bytes 


0 


128 bytes 


segment size of 8 Kbytes to 64 Kbytes - 1 byte 


1 


1Kbyte 


segment size of 64 Kbytes to 256 Kbytes - 1 byte 


2 


8 Kbytes 


segment size of 256 Kbytes to 2 Mbytes -1 byte 


3 


64 Kbytes 


segment size of 2 Mbytes to 1 6 Mbytes - 1 byte 


4 


512 Kbytes 


segment size of 16 Mbytes to 128 Mbytes - 1 byte 


5 


4 Mbytes 


segment size of 128 Mbytes to 1 Gbyte - 1 byte 


6 



1 5 Table 1 : Granule size and memory segment size range according to level 
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Fragmentation is directly related to the granule sizes. The smaller the 
granule sizes, the lower is the fragmentation. On the other hand, the smaller the 
granule sizes, the smaller is the maximum manageable memory segment size. Thus, 
there is a trade off between the granule sizes and the maximum manageable 
5 memory segment size. Therefore, the granule sizes are selected in accordance with 
the size of memory blocks to be allocated. For example, if the size of requested 
memory blocks does not exceed 4 Kbytes, a granule of 16 bytes for level 0 permits 
to support 255 segment sizes ranging from 1 byte to 4 Kbytes. This increases the 
memory use efficiency considerably. 
1 0 As indicated above, each level is associated with a table of up to 255 

pointers. However, instead of scanning the table of pointers of a level in order to 
allocate a free a memory segment, a three stage bitmap is used. Thereby, a 
deterministic behaviour of the' memory allocation algorithm is provided. This 
approach also considerably speeds up the identification of a free memory segment 
15 of the right size. 

An exemplary three stage bitmap for use in an embodiment of the present 
invention is illustrated in Figure 2. The bitmap comprises a root bitmap 1 (first 
stage), a second stage bitmap 2 and a third stage bitmap 3. The root bitmap 1 is an 
8-bit word of which each bit controls an associated 8-bit word of the second stage 
20 bitmap 2. If one or more bits of an associated 8-bit word of the second stage bitmap 
2 is set to 1, the corresponding root bitmap bit is also set to 1. Similarily, each bit of 
the second stage bitmap 2 is associated with 32 bits of the third stage bitmap 3. If 
one or more bits of a 32-bit word of the third stage bitmap 3 is set, the 
corresponding bit of the associated second stage bitmap 2 is also set to 1. 
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Consequently, each bit of the root bitmap 1 represents 256 bits of the third stage 
bitmap 3. Accordingly, the third stage bitmap 3 comprises 256-bit strings each 
consisting of eight 32-bit words. 

Each bit of the third stage bitmap 3 is associated with an entry in the table of 
5 pointers. By using a three stage bitmap, scanning a 256-bit array (i.e. a table of 
pointers for one level) for free memory segments may be performed by checking 
only one bit of the root bitmap, as will be described in further detail hereinbelow. 
Thereby, scanning operations are simplified and sped up considerably. 

In the present embodiment, the root bitmap 1 and the second stage bitmap 2 
1 0 consist of 8-bit words. However, in an alternative embodiment for different 
applications, the root bitmap and the second stage bitmap may consist of 32-bit 
words, whereby each bit of the root bitmap represents 1024 bits of the third stage 
bitmap. 

The algorithm of the present embodiment allocates a best fitting memory 
1 5 segment in response to a memory allocation request. The algorithm is illustrated in 
Figure 3. The size of the requested memory block is contained in a 32-bit word 10, 
as illustrated in Figure 4. The requested memory block size is rounded up to the 
nearest factor of the lowest granule size, i.e. 32 bytes in the present embodiment. 
A set of seven 32- bit word masks 1 1 and a lookup table 12 containing 3 1 
20 entries are used to determine in a single operation the appropriate level and 
corresponding indexes into the associated bitmaps (root, second and third stage 
bitmaps). The masks 1 1 are predetermined and each associated with one of the 
levels. 
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The content of the lookup table 12 is computed on initialization. After 
rounding the requested memory block size in accordance with the smallest granule 
size, as mentioned above, the highest set bit of the 32-bit word 10 is determined 
starting from the most significant bit. The highest set bit represents an index to an 
5 entry in the lookup table 12 containing the level corresponding to the size of the 
requested memory block. It also indexes one of the masks 1 1 which is associated 
with that level. 

The level determined this way indexes an associated bit of the root bitmap 1. 
If this bit is set to 1, indexes to the first and second stage bitmaps 2, 3 are computed. 
10 The indexes to the first and second stage bitmaps 2, 3 are computed by logically 
combining the content of the 32-bit word 10 and the mask indexed by the lookup 
table 12. The logical combination is an AND/SHIFT operation. 

If the indexed bit of the third stage bitmap 3 is set to 1, a free memory 
segment of the required size has been found. Otherwise, a larger free segment will 
1 5 have to be found and allocated. Searching a larger segment comprises the following 
steps, as illustrated in Figure 5: 

Finding the next set bit in the current 32-bit word of the third stage bitmap 3; 
If no other bit is set in the current third stage 32-bit word, find the next set 
bit in the current 8-bit word of the second stage bitmap 2; 
20 - If not other bit is set in the current second stage 8-bit word, find the next set 
bit in the root bitmap 1 . 

If no other bit is set in the root bitmap 1, there is no free memory segment to 
satisfy the memory allocation request, and a null pointer is returned. 
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First Example 

In the first example, the overall memory is 1 Gigabyte, all of which is free. 
A request is received for the allocation of 400 bytes. 

In the first step, the size of the requested memory is rounded in accordance 
5 with the smallest granule size, i.e. 32 bytes (granule size of level 0). This results in 
a rounded size of 416 bytes, corresponding to the binary digit 1 10100000. This 
binary digit is contained in the 32-bit word 10 (Figure 4). 

Subsequently, the highest set bit of the 32-bit word 10 is determined. This is 
bit no. 8, corresponding to an index to the 8th entry of the lookup table 12. The 
10 eight entry of the lookup table 12 indicates the level corresponding to the size of the 
requested memory block, that is level 0 in the present example. In the next step, the 
content of the bit of the root bitmap 1 associated with level 0 is determined. In the 
present example, the level 0 bit of the root bitmap 1 is 0, as the whole memory is 
free and there is only one free segment of 1 Gigabyte, i.e. all bits of the root bitmap 
1 5 1 except the most significant one are 0. Due to this result, no AND/SHIFT 

operation is performed to compute indexes to the second and third stage bitmaps. 

As the level 0 bit is 0, the next set bit of the root bitmap 1 is determined. As 
explained above, this is the highest bit of the root bitmap 1, i.e. that associated with 
level 6. 

20 Then, the lowest set bit of the second stage bitmap 2 is determined. This is 

bit no. 7, i.e. the highest significant bit of the second stage bitmap 2. Similarily, the 
lowest set bit of the 32-bit word of the third stage bitmap 3 associated with bit no. 7 
of the second stage bitmap 2 is determined. This is the most significant bit of the 
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32-bit word, i.e. bit no. 3 1 . This bit is associated with a pointer indicating the 
physical memory address of the free memory segment to be allocated. 

In the present example, the size of the free memory segment is 1 Gigabyte - 
1 byte (compare table 1), whereas only 416 bytes are requested. Therefore, the free 
5 segment is split into two, that is one allocated segment of the size <448 (see Figure 
1) and one new free segment of 1 Gigabyte - (448+1) bytes. The bitmap is updated 
accordingly. 



Second Example 

10 In the second example, the overall memory size also 1 Gigabyte. All 

memory is allocated except one segment in level 0 (say <1024 bytes) and one in 
level 1 (say <32,768 bytes). A request is received for 18,030 bytes. 

In the first step, the request is rounded to 1 8,048 bytes. This corresponds to 
the binary digit of 10001 1010000000. Accordingly, the highest set bit of the 32-bit 
15 word 10 is bit no. 15. 

In the next step, entry no. 15 of the lookup table 12 is determined. This is an 
index to level 1, in accordance with the size of the requested memory. 

Subsequently, the state of the level 1 bit of the root bitmap 1 is determined. 
As there is a free memory segment in level 1, this bit is set to 1. 
20 Then, an AND/SHIFT-operation is performed on the binary digit 

corresponding to the size of the memory request (10001 1010000000) and the level 1 
entry of the masks 1 1 (1 1 1 1 1 1 1 1000000, corresponding to 7F80). The operation 
result is 10001 101. 
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The operation results indexes those bits of the second and third stage 
bitmaps which are associated with a best fitting memory segment size. In this 
example, this is bit no. 4 of the second stage bitmap 2 and bit no. 13 of 32-bit word 
of the third stage bitmap 3 associated with bit no. 4 of the second stage bitmap 2. 
5 This corresponds to pointer no. 141 (= operation result), indicating the physical 
memory address of the segment <1 8,176 bytes being the best fitting size. In 
particular, the three most significant bits (100) of the operation result correspond to 
bit no. 4 of the second stage bitmap 2, whereas the five least significant bits of the 
operation result correspond to bit no. 13 of the third stage bitmap 3. 

1 0 However, since there is no free memory segment of this size, bit no. 1 3 of 

the third stage bitmap is 0. Therefore, the third and second stage bitmaps are 
searched until a set bit in the third stage bitmap 3 is found, as described above. In 
the present example, this is the most significant bit of the 32-bit word of the third 
stage bitmap 3 associated with the most significant bit of the second stage bitmap 2 

1 5 of level 1 , corresponding to a free memory segment of the size <32,768 (pointer no. 
256). 

Subsequently, this free memory segment is split into two, that is one 
allocated segment of the size <1 8,176 bytes, and one new free segment of the size 
32,768 - (1 8,176 + 1) bytes. The bitmap is updated accordingly. 

20 

As indicated in the examples, initially, a free memory contains a single free 
segment, and only one bit is set in each of the root bitmap 1 , the second stage 
bitmap 2 and the third stage bitmap 3. 
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The third stage bitmap 3 is associated with a table of pointers indicating the 
address of free memory segments. The table of pointers is updated in accordance 
with the third stage bitmap. 

When a free memory segment is to be allocated and the segment is larger 
5 than the requested memory, it is split into two sub-segments according to the 

requested size. If the free sub-segment is to be allocated but is also too large, it can 
be split again and so forth. 

The algorithm response time only depends on the bitmap scanning 
operation. The root bitmap 3 allows for the determination of the availability of a 
1 0 free segment in each level in a single operation. 

Both the memory allocation and release operation are deterministic and 
. symmetrical, as they do not depend on the number of free or allocated segments, or 
upon the size of the requested memory. Both operations do not exceed a maximum 
time and are fully predictable. 

15 

Referring to Figure 6, a data structure used in the embodiment of the 
invention is described. Figure 6 illustrates the root bitmap 1 , the second and third 
stage bitmaps 2, 3 in each of the seven levels, as well as a table of pointers 15 
associated with the third stage bitmap 3 of each level. 
20 A memory 1 6 consists of free and allocated memory segments. Memory 

segments are linked using a first and a second doubly linked list 17, 1 8. The first 
doubly linked list 17 links all segments of the memory, regardless of state (free, 
allocated). The second doubly linked list 18 links free memory segments of the 
same size. 
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In the first doubly linked list 17, the order of segments accords with their 
physical memory addresses. The second doubly linked list 1 8 includes a number of 
lists each linking free segments of the same size. Each of these lists is organised as 
a LIFO (Last In First Out) list. 
5 The first doubly linked list 17 is updated each time a free segment is split (as 

described above) or free segments are merged (as described below). The second 
doubly linked list is updated each time a memory segment is freed or allocated, and 
also when a free segment is split or free segments are merged. When a segment is 
freed, the new free segment is added to the LIFO list corresponding to the size of 

10 the free segment. When a free segment is allocated, it is removed from the LIFO 
list corresponding to its size. When a free segment is split into two sub-segments, 
the free segment is removed from its LIFO list, and the new free sub-segment is 
added to another LIFO list according to its size. When free segments are merged, 
they are removed from their respective LIFO lists, and the new merged free segment 

1 5 is added to another LIFO list according to its size. In each case, the bitmap is 
updated accordingly. 

In Figure 6, the second doubly linked list 18 includes three lists 19, 20 and 
21 associated with level 0, 1 and 6, respectively. 

As indicated above, when a memory segment is freed, it is merged with 

20 neighboured free segments in order to form a larger free segment. The underlying 
algorithm is illustrated in Figure 7. When a segment is freed, the state of the 
neighboured segments is determined. If both neighboured segments are free, all 
three segments are merged. If only one of the neighboured segments is free, then 
the two free segments are merged. If no neighboured segment is free, no merge 
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operation is performed. As a consequence, there are never any neighboured free 
segments, as these are merged on freeing one of the segments. 

The state of neighboured segments is determined using the first doubly 
linked list. The structure of the first doubly linked list 17 is illustrated in Figure 8. 
5 Each memory segment has a header 25 which includes information on the state of 
the segment (free, allocated) and the size of the segment, as well as a pointer 
pointing to the previous segment. In particular, the state of the segment is indicated 
by the lowest significant bit of the pointer. A pointer to the subsequent segment is 
not necessary as its address can be determined from the segment size. 
10 Figure 9 illustrates a data structure including the first and second doubly 

linked lists 17, 18. In particular, Figure 9 illustrates that the first doubly linked list 
links all segments, whereas the second doubly linked list 18 links free segments of 
the same size only. Therefore; the header 25 of a free segment includes additional 
pointers to the next and the previous free segments of the same size. If there is only 
15 a single free segment of any given size, these pointers form a loop and point to the 
header 25 of that single segment. 

The header 25 consists of 8 bytes for an allocated segment, and of 12 bytes 
for a free segment; in the latter case, the additional bytes contain information on 
other free segments of the same size thereby to form the second doubly linked list 
20 1 8, as described above. 

It is noted that in the above description of the allocation of a best fitting 
memory segment, the memory additionally required to form the header 25 is 
disregarded for the sake of simplicity. 
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Table 2 illustrates the memory consumed by the bitmaps and tables of 
pointers used in the present memory allocation algorithm for different memory pool 
sizes, provided the granule size for each level is selected in accordance with table 1 : 



Memory pool size 


Tables of pointers 


Bitmaps 


Total 


32 Kbytes 


2 Kbytes 


67 bytes 


2115 bytes 


256 Kbytes 


3 Kbytes 


100 bytes 


3172 bytes 


2 Mbytes 


4 Kbytes 


133 bytes 


4229 bytes 


16 Mbytes 


5 Kbytes 


166 bytes 


5286 bytes 


128 Mbytes* 


6 Kbytes 


199 bytes 


6343 bytes 


1 Gbyte 


7 Kbytes 


232 bytes 


7400 bytes 



5 ' Table 2: Memory consumed by tables of pointers and bitmaps 



In addition, two tables of 256 bytes are required to perform computations to 
determine the first set bit starting from the least and from the most significant bit, 
respectively. Thus, an additional 512 bytes are required. Further, the doubly linked 
10 lists 17, 18 consume 8 bytes per allocated or 12 bytes per free segment. 

Table 3 indicates the response times (in nano seconds) on different 
processors of the present algorithm when performing allocation and release 
operations: 



16 



WO 2005/081113 



PCT/EP2005/001480 





Intel i486 
33MHz 


Pentium 
300 MHz 


PowerPC 
300 MHz 


Clock accuracy 


+/- 838 


+/-3 


+/-60 


Allocate 








Alloc Exact Matching 


7000 


390 


240 


Alloc SCBM 


15,000 


865 


540 


Alloc SUBM 


17,000 


1,074 


554 


Alloc SRBM 


17,000 


1,144 


600 


Free 








Free, no merge 


6,000 


307 


224 


Free, merge 1 neighbour 


10,000 


349 


420 


Free, merge 2 neighbours 


14,000 


795 


600 


Table 3: Response time on dii 


ferent processors 



As indicated in Table 3, there are three instruction paths for allocating a 
5 segment: 

-SCBM (Scan Current 32-bit word of the third stage BitMap). In this case, a 
free segment is found in the current 32-but word of the third stage bitmap 3 
(compare Figure 5). 

-SUBM (Scan Upper level of the BitMap). In this case, there is no free segment 
10 in the current 32-bit word of the third stage bitmap 3, and the current second 

stage bitmap 2 is scanned to find a free segment (see also Figure 5). 
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-SRBM (Scan Root BitMap). In this case, there is no free segment in the 

current 32-bit word of the third stage bitmap 3, nor the current second stage 
bitmap 2. A free segment is found by scanning the root bitmap 1 . 

There are also three instructions paths for releasing (freeing) a segment: 
-Free a segment while both neighboured segments are allocated. No merge 

operation is performed. It is therefore the fastest path. 
-Free a segment while there is one free neighbour. One merge operation is 
performed. 

-Free a segment while both neighboured segments are free. Two merge 
operations are performed. This is therefore the slowest path. 

Each response time of Table 3 is a mean value of 1000 operations. Worst 
cases are about two to three times slower than the respective best case (i.e. exact 
1 5 matching when allocating segment; no merging when freeing a segment). However, 
for an overall memory not exceeding 1 Gbyte, the response time never exceeds 
17,000 ns on a 33 MHz i486 processor, 1,144 ns on a 300 MHz Pentium processor, 
and 600 ns on a 300 MHz PowerPC processor, regardless of the number of free or 
allocated segments or the size of the requested memory. Accordingly, the present 
20 algorithm is deterministic and predictable. 

It should be noted that the invention is not limited to the above described 
exemplary embodiment and it will be evident to a skilled person in the art that 
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various modifications may be made within the scope of protection as determined 
from the claims. 



19 



